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ON (54) Title: METHOD TO CONTROL POINT SPREAD FUNCTION OF AN IMAGE 



(57) Abstract: A method of controlling the point spread function of an image projected with said image being diffused by a filter; 
said point spread function is a result of the application of spatial filter(s) on said image; with said control of the point spread function 
effected by varying the distance between such image and said spatial filter(s) and varying the bidirectional scattering transmission 
function of the spatial filter(s). Said spatial filter may be a holographic diffuser, which by method of manufacture has a well defined 
bi-directional scattering transmission spread function. Control of said spread function is particularly useful to maintain image quality 
while abating moire interference in situations where two periodic patterns are layered causing moire interference. 
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Title: Method to Control Point Spread Function of an Image 

We Deep Video Imaging Limited a New Zealand company of Airport Road, Mystery 
Creek, RD2 Hamilton, New Zealand do hereby declare this invention to be described 
in the following statement: 

5 Technical Field 

This invention relates to the field of improved imaging technology. In particular, 
this invention will be discussed in relation to display technology with multiple 
image layers. 

Reference shall now be made to use of the present invention in relation to multiple 
10 layered display technology. 

Background Art 

There are two main types of displays used in computer monitors, passive matrix 
and active matrix. Passive-matrix displays use a simple grid to supply the charge to 
a particular pixel on the display. Creating the grid starts with two glass layers 
15 called substrates. One substrate is given columns and the other is given rows made 
from a transparent conductive material. This is usually indium tin oxide. The rows 
or columns are connected to integrated circuits that control when a charge is sent 
down a particular column or row. The electro-optical material is often sandwiched 
between the two glass substrates. 

20 A pixel is defined as the smallest resolvable area of an image, either on a screen or 
stored in memory. Each pixel in a monochrome image has its own brightness, from 
0 for black to the maximum value (e.g. 255 for an eight-bit pixel) for white. In a 
colour image, each pixel has its own brightness and colour, usually represented as a 
triple of red, green and blue intensities. To turn on a pixel, the integrated circuit 

25 sends a charge down the correct column of one substrate and a ground activated on 
the correct row of the other. The row and column intersect at the designated pixel 
and that delivers the voltage to untwist the liquid crystals at that pixel. 
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The passive matrix system has significant drawbacks, notably slow response time 
and imprecise voltage control. Response time refers to the display's ability to 
refresh the image displayed. Imprecise voltage control hinders the passive matrix's 
ability to influence only one pixel at a time. 

5 When voltage is applied to change the optical state of one pixel, the pixels around it 
also partially change, which makes images appear un-sharp and lacking in contrast. 

Active-matrix displays depend on thin film transistors (TFT). Thin film transistors 
are tiny switching transistors and capacitors. They are arranged in a matrix on a 
glass substrate. To address a particular pixel, the proper row is switched on, and 

10 then a charge is sent down the correct column. Since all of the other rows that the 
column intersects are turned off, only the capacitor at the designated pixel receives 
a charge. The capacitor is able to hold the charge until the next refresh cycle; and if 
the amount of voltage supplied to the crystal is carefully controlled, it can be made 
to untwist only enough to allow some light through. By doing this in very exact, 

15 very small increments, displays can create a grey scale. Most displays today offer 
256 levels of brightness per pixel. 

Displays that can show colours may have three sub -pixels with red, green and blue 
colour filters to create each colour pixel. Through the careful control and variation 
of the voltage applied, the intensity of each sub-pixel can range over 256 shades. 
20 Combining the sub-pixels produces a possible palette of 16.8 million colours (256 
shades of red x 256 shades of green x 256 shades of blue). These filters are arranged 
such that they form vertical red, green and blue stripes across the panel. 

The frequency spectrum of radiation incident upon a detector depends on the 
25 properties of the light source, the transmission medium and possibly the properties 
of the reflecting medium. If one considers the eye as a detector the human visual 
system can sense radiation that has a wavelength between 0.6nm and 380nm. 
Hence this is described as the visual part of the electromagnetic spectrum. Humans 
perceive certain frequency distributions as having different colours and brightness. 
30 A scheme was devised to describe any perceived colour and brightness via adding 
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three basis spectral distributions with various weights. For example in the 1931 
CIE colour space any perceivable colour may be described by the following equation: 

C=xX+y Y+zZ 
r r 

Where C is the colour being described, Xr, Yr and Zr are the weights and X,Y and Z 
are 1931 CIE tristimulis curves which are graphs of the relative sensitivity of the 
eye Vs wavelength. For any given colour, the weights may be determined by the 
following equations: 



X = 

r 



> 

J c(x)x(x)dX 



y r = 



f r ^ 



z - 
r 



( r ^ 



The 1931 co-ordinates are formed via the following normalisation: 

x 

r 

* ~ X + Y + Z 
r r r 

Y 

_ r 

Yf " X + Y + Z 
r r r 

z = 1 - x - y 
r r J x 

These may be plotted on the 1931 CIE diagram. The spectral locus defines the pure 
spectral colours, that is the perception of radiation with a specific wavelength. 
Colour co-ordinates that are closer or farther from pure spectral colours are 
described as being more or less saturated respectively. The value of the y 
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coordinate multiplied by 683 is also referred to as the luminance denoted by the 
symbol L. 

The perception model described above accurately predicts that colours on 
5 addressable objects can be formed by mixing small areas of three basis colours with 
modulated intensities which are close in either close spatial or temporal proximity. 
If the basis colours are plotted on the CIE diagram then the enclosed triangle 
contains all the colours producible by the system. The enclosed area is called the 
colour gamut and hence a addressable object with a larger area can addressable 
10 object a greater variation in colour and has a greater colour gamut. 

Displays employ several variations of liquid crystal technology, including super 
twisted nematics, dual scan twisted nematics, ferroelectric liquid crystal and 
surface stabilized ferroelectric liquid crystal . They can be lit using ambient light in 
15 which case they are termed as reflective, or backlit and termed transmissive. There 
are also emissive technologies and reflective technologies such as Organic Light 
Emitting Diodes and electronic ink which are addressed in the same manner as 
Liquid Crystal displays. 

20 At present there exist displays that by various means enable the stacking of 

addressable object planes at set distances. As well as the binocular depth cue, they 
feature intrinsic motion parallax, where the x and y distance changes between 
objects displayed on different planes depending on viewing angle. Additionally 
separate focal planes may be literally be brought in and out of focus depending on 

25 the focal length of the lens in the viewers eye. These displays consist of a high- 
brightened backlight, a rear image panel which is usually an active matrix, colour 
liquid crystal display, a diffuser, a refractor and a front image plane which are 
laminated to form a stack. There are generally colour filter stripes as mentioned 
above, and a black matrix on each display which defines the borders of the pixels. 

30 However it should be appreciated that the following discussion applies to all 

addressable object planes that are addressed by passive or active matrices or have 
colour filters arranged in any periodic pattern, or any optically active periodic 
pattern. The displays are close to each other, as far as the viewer is concerned they 
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form two similar, but not identical periodic patterns on the retina. This is because 
the solid angle subtended by the repeating patterns is different, which causes the 
colour stripes and black matrix boundaries to have slightly different pitches when 
projected onto the retina. 

5 These conditions are sufficient to cause a phenomenon called moire interference, 
which is characterized by large, annoying vertical red, green and blue stripes. The 
diffuser combats the interference by spreading the intensity distribution of the 
image formed by the colour filters. However while this may help remove moire it 
has the effect of changing the bidirectional scattering transmission function of the 

10 sub-pixels, smearing them to a point spread function thus effectively reducing the 
resolution of the display. Therefore to make a good display or optical system where 
the image remains sharp and the amplitude of the moire interference is hardly 
noticeable, these two conflicting factors must be carefully controlled. 

Typically the diffuser is of the form of a chemically etched series of surface features 

15 on a thin (0.000115 meter), birefingent substrate such polyester. If the pattern was 
viewed under a microscope at lOOOx magnification it would be undulating in 
topology. Because of the polarised nature of the displays this can cause the total 
luminance, which is evaluated at the front display by the viewer, to be reduced 
because it changes the degree and polarization orientation from the optimum. A 

20 similar pattern is available on a non-birefringent surface such as acrylic but this 
substrate cannot be made thin enough as not over -blur the rear most pixels. In 
general one cannot easily control the angular distribution of the light as it exits a 
typical diffuser. Also because there is an extra layer in the optical stack, extra air- 
plastic or air-glass interfaces are formed causing back reflections. These decrease 

25 the brightness of the display because at least 4% of the light is directed towards the 
backlight, as opposed, to the viewing direction. The ratio of the reflected and 
transmitted radiation is given by Fresnel's equations which are well known in the 
art. Note that if a ray is at some angle from the normal significantly more than 4% 
of light may be reflected. This reflected light may also be re-reflected out to the 

30 viewer, but may not appear to come from the correct origin, reducing the contrast of 
the display. Also because the film is on a separate sheet it has the tendency to 
deform due to the heat from the high-brightness backlight which is visible to the 
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viewer and can exasperate the sharpness problem described above. Point spread 
functions for typical, commercially available diffusers are circularly symmetric, that 
is their gain is constant for a given radius. 

A holographic diffuser is a transparent or translucent structure having an entrance 
5 surface, an exit surface, and light shaping structures formed on its entrance surface 
and/or in its interior. These light shaping structures are random, disordered, and 
non-planar micro sculpted structures. 

These structures are created during recording of the medium by illuminating the 
medium with a speckle pattern produced in conjunction with coherent light or the 

10 combination of incoherent light and a computer-generated mask which simulates 
speckle. The speckle produced changes in the refractive index of the medium which, 
when developed, are the micro-sculpted structures. These light shaping structures 
diffract light passing through the holographic diffuser so that the beam of light 
emitted from the holographic diffuser's exit surface exhibits a precisely controlled 

15 energy distribution along horizontal and vertical axes. Holographic diffusers can be 
used to shape a light beam so that over 90% (and up to 95%-98%) of the light beam 
entering the holographic diffuser is directed towards and into contact with a target 
located downstream of the holographic diffuser. A holographic diffuser can be made 
to collect incoming light and either (1) distribute it over a circular area from a 

20 fraction of a degree to over 100 degrees, or (2) send it into an almost unlimited 
range of elliptical angles. For example, a 2degree x 50 degree, holographic diffuser 
will produce a line when illuminated by a LED or laser and a 35 degree x .90 degree. 
Thus a holographic diffuser is not a typical example of a diffuser, since it may send 
most of the incoming light out at elliptical angles and these particular angles may 

25 be finely controlled. 

The following discussion describes pixel patterns used in the imaging industry. For 
the purposes of illustration it is assumed a sub-pixel is a 0.1 mm x 0.3 mm rectangle, 
with the long axis of the rectangle in the y direction and a pixel is a 0.3 mm x 0.3 
mm square, however it should be appreciated that a pixel can be any shape that is 
30 possible to tessellate and a sub pixel can be any one of a set of shapes which are 
possible to tessellate in combination. To define this rigorously consider a set of 
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regular points in 2D space forming a lattice and the same collection of pixels or 
sub-pixels at these points. Then the pixel pattern is wholly described by the lattice 
and the collection of sub-pixels or pixels at that point which are called a basis. The 
lattice can in turn be described by a primitive lattice cell comprised of two linearly 
5 independent vectors which form two sides of a parallelogram. 

The following radio metric quantities will be used throughout this specification are 
defined below: 



Luminous Flux is the flow rate of visual energy and is measured in lumens. 

10 

Illuminance is a measure of photometric flux per unit area, or visible flux density. 
Illuminance is measured in lux (lumens per square meter). 



Luminance is the illuminance per solid angle. 

15 

To appreciate the solid angle concept consider a spherical surface of radius r 
containing an area element A4 . The solid angle at the centre of the sphere is 

defined to be r . 

Pixels on a transmissive addressable object will be capable of maximum and 
20 minimum luminous states. Labelling the maximum state as Lb and the minimum 
as La then the contrast ratio is described by 




The term contrast ratio is usually abbreviated to just contrast. 



25 



From http://www.cquest.utoronto.ca/psych/psy280f/ch5/csf.html 

"The contrast sensitivity function (CSF) plots the contrast sensitivity for the human 
visual system ( 1 / (contrast threshold) ) for all spatial frequencies. Viewers are most 
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sensitive to intermediate frequencies (~4 - 8 cycles per degree). Viewers are less 
sensitive to lower frequencies, and less sensitive to higher frequencies. 

The CSF shows us the observer's window of visibility. Points below the CSF are 
visible to the observer (those are the points that have even higher contrasts than 
5 the threshold level). Points above the CSF are invisible to the observer (those are 
the points that have lower contrasts than the threshold level). The lowest visible 
frequency (at 100% contrast) is the low frequency cut-off, and the highest visible 
frequency (at 100% contrast) is the high frequency cut-off." 



10 

Disclosure of Invention 

According to one aspect of the present invention there is a method of controlling the 
point spread function; 

The term 'point spread function' is defined as the output of the imaging system for 
15 an input point source, in particular it describes the distribution of a single object 
point after passing through a filter with a particular spatial frequency response; 

in an optical system consisting of an object, at least one spatial filter, and the image 
projected by that object with said spatial filter(s) located between said object and 
said image where said point spread function is a representation of the application of 
20 spatial filter(s) on said image; 

with said point spread function controlled by varying the distance between said 
image and said spatial filter(s) and bidirectional scattering transmission function of 
the spatial filter (s). 

The spatial filter is characterised by the bidirectional scattering transmission 
25 distribution function, which describes how a small cone of light rays around a single 
point is transmitted through a surface. Said function is defined as 
dL 0 (a> 0 ) 



L(cu i )do- ± (co i ) w h ere t he left hand side of the equation is the observed 
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radiance in the direction of 0)0 , per unit of irradiance arriving from ^ The arrow 
on the left hand side of the equation symbolises the direction of the light flow. The 
equation on right hand side is the ratio of the luminance out to the illuminance in, 

contained in a small solid angle around 0)1 . 

5 The, or each, spatial filter may be any type of spatial filter used in known optical 
technology such as, for example, a holographic diffuser, prismatic filter, a hologram, 
or any filter that changes the direction of light in a defined way. Reference 
throughout this specification to a spatial diffuser is purely exemplary and should 
not be viewed as limiting in any way. 

10 Said point spread function can be determined by the following equation 

PW(r v 7 z ^- f s ^i^^o)L 0 {e H9 e v )A p J 2 

( M 2 M 2 ZoD X M 2 M 2 Zdl } (1) 



where 



^=tan- 1 (-^-) 
MZ OD 

0 v =Xim-\-^—) 
MZ OD J 



15 Table 1 introduces all of the relevant notation, note that one example of a projective 
system is the object, the cornea/lens and the retina system but the discussion 
pertains to any system containing an object, a lens an image:. 



x, y, z 


x, y, z coordinates 


Zod 


Distance along z axis between object and 
diffuser 
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Zdl 


Distance along z axis between diffuser 
and lens 


Zlr 


Distance along z axis between lens and 
retina 


QiOB 


Solid angle formed between point source 
and 8Ad 




0011& angle iormeci oetween tne 
intersection of the ray we are following 
and the diffuser plane 


M 


Magnification of the lens system 


1 1 


Modulus of a vector 


1 1 II 


Norm of a vector 


-> 


Direction of optic flow 




\\r * II 

II OD || 


^0 





This analysis enables one to take a spatial filter of a particular type, spaced at a 
particular distance from the display and to derive a linear transform to be used on a 
representation of the image. So the presence of the physical apparatus is not 
5 required to evaluate the correct BTDF, or portion thereof, and distance to provide 
the optimum image quality, saving development time and cost. 

Images that are portrayed and viewed using typical display technology are discreet 
approximations of the real world and are said to be pixelised. The diffusion of said 
pixelisation, so that the sharp boundaries between pixels are no longer perceptible, 
10 is one method to make the object appear more natural. Prior art diffusion and de- 
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pixelisation methods are subject to trial and error. Upon the application of a 
diffuser, or other spatial filter to an image the luminance as measured substantially 
in the direction perpendicular to the surface of the image layer, the viewer looking 
substantially in this direction when viewing or using the display, will be reduced 

5 and consequently the contrast will be reduced. Additionally if there are any 
interstitial elements between the image layer and the diffuser then it may not be 
possible to get the diffuser close enough to the image layer so as not to over blur the 
image. Prior art provides no way to finely control said depixelisation nor is there a 
way to predict for a given spatial filter at a given distance what the effect on the 

10 image will be in terms of contrast, luminance, point spread and most importantly 
the viewers perception of the image. The current invention describes a way to pre- 
determine, control and most importantly optimize the de-pixelisation process. 

The preferred point spread function should remove frequencies higher than the sub- 
pixel frequency, but none below. The ideal filter would be a perfect cut-off filter at 
15 the sub-pixel frequency. However given a range of physically realisable filters with 
known BTDFs a difference metric, such as differences between the square root 
integral, weighted by the contrast sensitivity function of the human visual system, 
can be used to determine the departure from the ideal, which can be minimised, so 
as to pick the best physical embodiment. 

20 According to another aspect of this invention it is desirable to maintain as far as 
practical the contrast and luminance characteristics of the original object. Also it is 
preferable, because of the presence of interstitial optical films of significant 
thickness, to be able to have the spatial filter as far from the image as possible. 
This is achieved when the bi-directional transmission distribution function is 

25 narrow for all input angles. 

According to another aspect of the present invention point spread function can be 
pre-determined and the trade off between moire interference and image clarity 
abated; 

in an optical system consisting of at least two addressable object planes with 
30 periodicity and at least one spatial filter between at least two of the addressable 
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object planes where said point spread function is a result of the application of 
spatial filter(s) on said image, 

with said point spread function being controlled by varying the distance between an 
object and said spatial filter (s) and varying bidirectional scattering transmission 
5 function characteristic of the spatial filter (s). 

In typical multilayered technologies moire interference is caused due to the 
periodicity of the layers. Diffusion techniques can be employed to abate moire 
interference. However methods employed in prior art are subject to trial and error 
and result in residual moire interference and an unnecessarily large drop in the 
10 perceived quality of the image. 

The moire interference as it appears on the image plane can be characterised by the 
following equation which describes the luminous intensity of the final image 
evaluated at the retina or any other image plane 



y £BL 0 ^PSF(x 9 yy 

i-\..m 



R(x,y) R nX) RediR 
R(x 9 y) B T(A) 3fR 



)[F(x,y) R nX\ edtF F(x,y) G T(X) GtF F{x,y) B T{X) BtF ]m 2 A Jens cos 4 (0) 



15 (2) 

Where BLo is the radiance of the backlight, PSF(x,y) is the point spread function 
described earlier, TRed, Tg and Tb are the spectral transmission functions of the dye 
layers where second subscripts R and F designate the front and rear imaging 
layers respectively, M is the magnification of the thin lens system given by z7z 0 and 
20 Aiens is the area of the lens in the system. 

Once the intensity distribution on the back of the retina is known the distortion to 
the subjective image quality is described by the following metric 



1 K max 

J— f 



M,(v) 



M2) „ \ 



M D (y) jn , 



M t (v) 



25 



15 
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M M (y) 



M,(y) 



d{\n(y)) 



D = D 1+ D 2 (3) 

where 

F x .(v)/F x (0) 



M(v) = 



F x (v)/F x (0) 



is defined as the modulation transfer function 

where ^x<i y ) and F x (y) are representations of the distorted and 
undistorted images in the frequency domain respectively and 

^r(0)=-^r(0) are the average luminance's of the distorted and undistorted 
images 

M ,= 1 

10 • CSF(o)(y)) w h ere CSF(coi) ^ g ^ e contrast sensitivity function 

• ^ D ^ is the filtered image and ^ is the un- filtered image that is 
being compared 

• Mm ^ is the image with moire and ^ is the ideal image without 



moire. 



Preferably, there is little perceptible moire interference present and the object 
maintains its original image quality, and as such the BDTF of the spatial filter and 
the distance of said spatial filter from the display is picked such that the value of D, 
in equation (3) above is at a minimum for any given set of pixel patterns. 

20 The advantages will become clear when the modern product development process is 
considered. Nowadays the this could be broken down into the following five phases 

i. Specification 

ii. Soft prototyping 

iii. Hard prototyping 
25 iv. Validation 

v. Manufacturing 

Within the development process, steps (ii) to (iv) are repeated many times, to get 
the product to the point where the it is suitable for manufacture. Step (ii) in the 
modern process requires the use of computer aided design tools which significantly 
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reduce the number of iterations at step (iii). There exist no specialised tools in the 
prior art for the purposes of multi-layered optics, typically those available use 
Monte Carlo ray tracing techniques which involve large numbers of calculations. 

According to another embodiment of this invention the results contained within 
5 equations (1), (2) or (3) are incorporated into an algorithm where 

(i) The distance between the spatial filter and the object 

(ii) The pixel structure for the object layers 

(iii) The available spatial filters 

(iv) The refractive indices within the optical stack 
10 are entered and the algorithm provides 

(a) a subjective image quality value for each combination of the above 
parameters 

(b) the best configuration of the distance between layers and the spatial filter. 
The algorithm provides a procedure to preserve the image quality by the and abate 

15 more interference by the manipulation and optimization of the point spread 
function acting on the image caused by the spatial filter, and additionally provides a 
simple, timely means to do this in absence of a group of observers and at the soft 
prototype stage. 

To further appreciate the advantages of a soft prototyping system, in terms of cost 
20 and time, over a trial and error approach consider the following example: In multi- 
layered displays the gap between the diffuser and object layer is controlled by 
"adjusting" the thickness of a birefringence free substrate such as glass or acrylic. 
In reality this adjustment is not trivial. Because layers in the stack are viewed 
through polarizers, any stress on or within these layers causes birefringence which 
25 appears as coloured or dark patches within the display. So cast acrylic is generally 
used, as extruding the material induces stress, introducing unwanted birefringence 
into the multi-layered display stack. On the other hand if the casting method of 
forming the acrylic is used, there is no birefringence present however the thickness 
across the sheet can vary by millimetres resulting in variable image quality. There 
30 exist proprietary methods to overcome this dilemma, however there is no "real time" 
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adjustment possible. In order to change the thickness of the substrate die and 
machine set-ups need to be altered resulting in considerable delays and expense. 

Additionally there is the problem that one needs to have a physical object, that is 
one cannot determine the correct thickness of acrylic to be used by specification of 
5 the object alone. If the object is a flat panel display then it is necessary that the 
display be first constructed, which can take between 6 and 12 months and incur 
large costs, typically in the order of millions of $USD. This implies that there is no 
way of determining the optimum object specification, so a display that is optimised 
for the purposes of layering can be specified correctly first time. 

10 According to yet another aspect of the present invention an image will have a 
periodic pattern which is asymmetric. Pixel patterns which are commonly employed 
in display technologies are asymmetric. For example the red, green, blue stripe 
pattern commonly found in liquid crystal displays and other display technologies 
are asymmetric in their arrangement. 

15 Commonly available filters are circularly symmetric. The result of applying a 
circularly symmetric filter on an asymmetric pixel image pattern is a circularly 
symmetric point spread function — resulting in over-blurring of the initial image 
and over degradation of the image quality. 

In another embodiment of the invention control spread function caused by a spatial 
20 diffuser acting upon an image with an asymmetric pattern can be soft and hard 
prototyped by varying the distance between such image and said spatial filter(s) 
and by varying bidirectional scattering transmission function of the spatial filter(s). 
Preferably the spatial diffuser employed is of known characteristics such that its 
bidirectional scattering transmission function is asymmetric. 

25 Preferably the spatial diffuser used in the present invention will be a holographic 
diffuser. 

According to yet another aspect of the present invention point spread function can 
be soft and hard prototyped and moire interference abated; 
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in an optical system consisting of a at least two addressable object planes with 
periodicity and at least one spatial filter between at least two of the addressable 
object planes where said point spread function is a result of the application of 
spatial filter(s) on said image, 

with said point spread function being controlled by varying the distance between 
such image and said spatial filter(s) and independently varying the BTDF 
characteristic of the spatial filter(s) along any axis in the x-y plane. 

In typical display technologies there is a black matrix defining the borders of the 
sub-pixels on an object layer in order to hide any manufacturing defects. Two, or 
more, of these layers combined when imaged on the retina produce a pattern 
composed of lines of greater and lesser spatial density. This pattern is perceived as 
bright and dark stripes. The black matrix is approximately an order of magnitude 
smaller than the size of the sub-pixel and requires only a small amount of spreading 
in the x and y directions. 

On the other hand in a stripe pattern for example the coloured sub-pixels on the 
requires spreading across their nearest neighbours in the x direction. 

So the stripe pixel pattern is a superposition of this situation and ideally is spread 
exactly over the width of two sub-pixels in the x direction and exactly the width of 
the black matrix in the y direction. 

According to one aspect of the present invention coloured and black moire is 
overcome by control of an asymmetric point spread function . 

According to yet another aspect of the present invention point spread function can 
be soft and hard prototyped and moire interference abated; whilst maintaining 
image quality. 

Generally, a given point within a region on an image plane surrounded by a group 
of regions with substantially the same optical emission spectrums or absorption 
profiles, then is preferable, to control the point spread function the extent practical, 
to spread the point no further than half the distance to the nearest point on the 
border of the boundary of the nearest neighbouring region to avoid moire 
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interference with another image layer and maintain the image quality on the image 
plane. The half factor is incorporated because the nearest neighbouring region is 
spread also. 

Preferably the spatial filter is a holographic diffuser, with full width half maximum 
5 less than 30 degrees on either the x or the y axis. 

Whilst the holographic diffusion pattern may be recorded using a laser and mask 
arrangement it can be reproduced, and indeed any diffusion pattern may be 
produced to within a given tolerance by many different methods. One such method 

10 is calender ending where an adhesive, usually epoxy that is curable by ultra-violet 
radiation, is applied to the desired surface and a 3D negative impression of the 
surface, on a transparent substrate, to be reproduced is pushed into the adhesive. 
The adhesive is then cured by applying the UV radiation through the substrate, and 
the substrate removed leaving a surface impression. Also the pattern may be 

15 applied to the surface during its manufacturing process, such as embossing the 
pattern onto a plastic sheet whilst the surface is still soft. It also may be applied 
using material removal systems such as acid or abrasion. Thus a pattern may be 
applied to any surface within the optical stack. 

20 Brief Description of Drawings 

Further aspects of the present invention will become apparent from the following 
description which is given by way of example only and with reference to the 
accompanying drawings in which: 

Figure 1 shows the setup for the working that shows how the point 

spread function can be calculated from the bi-directional transmission 
distribution function of the spatial filter 

Figure 2 shows the setup for the working that shows how the moire 

interference is described 

Figure 3 is a flow chart describing the software embodiment of the present 
invention 



25 



30 
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Figure 4 shows the effect of the two different bi-directional spread functions of 
figure two on a simplified version of the vertical stripe pattern. 



Figure 5 is a graph of the bi-directional spread function, where the horizontal 
and vertical axes give the row and column number of the element 
respectively and the vertical axis potrays the weight. 

Figure 6 shows the effect if narrower Vs wider bi-directional spread functions 
on the moire interference 

Figure 8 shows the a microscopic image of the holographic diffuser and its effect 
on an incident laser beam 



Figure 7 is a diagram disclosing the hardware embodiment of the present 
invention 

Figure 9 is a schematic view of a typical stripe pattern used in the art. Red, 
green and blue sub-pixels are arranged in a matrix where each pixel is 
formed from a triple of a red sub-pixel, a green sub-pixel and a blue 
sub-pixel. A sensor dragged across the display in the horizontal 
direction would detect red, green and blue sub - pixels if not on a 
horizontal strip of the black matrix. Conversely a sensor dragged in 
the vertical direction would only see red sub-pixels for example. 



Best Modes for Carrying out the Invention 

At present there exist methods to produce displays where several imaging planes 
are stacked with set distances between them. These imaging planes may also be 
stacked as closely as possible. These displays consist of a high-brightened backlight, 
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a rear image panel which is usually an active matrix, colour display, a diffuser and 
a front image plane, which are laminated to form a stack. There are generally 
colour filter stripes, and a black matrix on each display which defines the borders of 
the pixels. However it should be appreciated that the following discussion applies 
to all addressable object planes that are addressed by passive or active matrices or 
have colour filters, or any periodic pattern. For the purposes of the present 
invention these addressable object planes may not be addressable at all. 

It is an object of the present invention to address the foregoing problems or at least v 
to provide the public with a useful choice. 

Further aspects and advantages of the present invention will become apparent from 
the ensuing description which is given by way of example only. 

Reference throughout this specification will now be made to the present invention 
as applying to video display systems. However, it should be appreciated by those 
skilled in the art that other types of display and imaging systems may be used in 
conjunction with the invention, not necessarily being video screens. 

According to one embodiment of the present invention there is provided a 
mathematical model for predicting and optimising the trade-off between moire 
interference and image quality by use of a spatial filter within a multi-layered 
image system where said layers contain periodic elements. 

To determine the effect of a diffusion element on small features, such as font 
elements, on the an imaging layer consider the somewhat simplistic optical system 
shown in Figure 1. For the purposes of the metric and further modelling, the point 
spread function of the system in terms of the BTDF of the diffuser and its distance 
from the rear display is required. Since the image quality on the rear imaging layer 
is being examined the front imaging layer is not needed. The eye is modelled as a 
thin lens system where the images are focused on the fovea (1), a small region of the 
retina with very high cone density, at an angle of about 6-8 degrees to the optic axis. 
These "flat retina" and "thin lens" approximations are acceptable because the fovea 
forms such a small portion of the curved retina. Table 1 introduces all of the 
relevant notation. 
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X, V, z 


x, y, z coordinates 


ZoD 


Distance along z axis between object and 
diffuser 


Zdl 


Distance along z axis between diffuser 
and lens 


Zlr 


Distance along z axis between lens and 
retina 


Rod* 


Ray from object to diffuser 


Rdl* 


Ray form diffuser to lens 


Rlr* 


Ray from lens to retina 


8A d 


Small area surrounding the intersection 
of ray we are following with diffuser plane 


SAr 


Small area surrounding the intersection 
of ray we are following with retina plane 


£2oD 


Solid angle formed between point source 
and 8Ad 




Solid angle formed between the 
intersection of the ray we are following 
and the diffuser plane 


M 


Magnification of the lens system 


1 1 


Modulus of a vector 


MM 


Norm of a vector 


— > 


Direction of optic flow 




OD 











To begin the analysis the object layer is partitioned into a fine grid 



G 0 = 



(Wl) (Xl>y\) •'• Om^l) 

(x ly y 2 ) *'. (x„,y 2 ) 

• • • 



(1) 



10 which is mapped by the thin lens, focused to give a magnification M, to a grid on the 
retina 



G R = -M 



• • • 

• • • 

• • • 



(2) 
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The negative sign implies that the x coordinate has been reflected in the y axis and 
vice versa. Initially the position is required, so follow the path of a generalised ray 

ixviu c xx, c *° ' (2) behind the diffuser which is broken into three 
5 sections, R * OD (3), r *dl (4), and R *** (5) each a vector. r *od 9 whose direction is 

described by the inclination angles (^'^) (5) resolved into components in the 
horizontal z-x plane and vertical z-y plane respectively, is redirected by the diffuser 
at the point 

10 (*D*>yi> *)=( z on \M9 H \Z OD tan(0 K )) (3) 

Think of the point ( x *D>y*D) (6) as a new object which is then imaged by the thin 
lens. To determine the surrounding grid element at the retina take the imaged 
point and divide the x and y coordinates at the fovea by the grid size and round up 
15 to the nearest integer 



25 



30 



(x * v *\ = ( ± d y o\ 

M ' M (4) 

(x R *,y R *)= ( ce?7 {^~}' cei7 | 



y f * 



0 

(5) 



If the irradiance of the of the light entering the diffuser contained within a small 
20 solid angle is known the output luminance on the exit side at that point is 
determined from 

L D (6> 0 ) = L 0 (ar. )f s (m, -*a) 0 )Q D (or, ) 

SA 

= L 0 (m, )f s (m t -> a> Q ) — 

\ r od\ 

SA D 



= L 0 (nr -±co 0 ) 



(X D -Xq) (y D -y Q ) 2 

M 2 + M 2 +Z ° D ( 6 ) 



= dL 0 {m 0 ) 

J s 



Li(&i)dQ(&i) i s the bi-directional transmittance function for the diffuser 
element where 

™i = I^^od 11 
m =\\R" 



(7) 

Now the illuminance at the lens is 

E L = L(0 H ,0 v )dCl DL 



\R DL 
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''kens 



An 



Zd_, z 2 



M M 1 



J (8) 



And the flux through the lens is 



^lens = E LAens 



~ L Q (6 h ,6 v )- 



kens 



47V 



2 2 



J (9) 



To find the illuminance imaged at each grid area on the retina by the lens, which is 
10 the stimulus at that area, take the flux through the lens and divide it by the area of 
the corresponding grid element 



Xr 
}'R 



SA B 



15 So 



f s (m, -> m a )L Q (B„ ,0 V )A 

Lens • 



( M 2 + M 2 +Z - X ^ + M 2+Z ^ ) (10) 



However the result is required to be independent of the grid and so dissolve the 
ratio on the right hand side. The 



lim SA D _ ago 
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5A R -> 0 dA R 



for ^ ~f^ 5A o) an d since 



= MSx 0 M5y 0 
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= M 2 Sx 0 by 0 

= M 2 SAn 



dA o (13) 

and finally 



PSF(x v Z Z ^ fJ^^MMM^ M 2 

Ax D -x 0 ) (y D -x Q ) ay*g_ ys_ z 2. 

t 772 + 772 +jC OD Aj.,2 + A ,2 +Zj DL ) . 

M M M where 



10 



6 H =tan _1 ( 



MZ, 



OD 



MZ, 



OD 



(14) 



An intuitive way to think about moire is shown in Figure 2 which shows two 
15 gratings of slightly different wavelengths (7) overlaid. When each of these screens 
is imaged by the lens on the same plane there is interference (8) between two 
square waveforms of slightly different frequency - which, considering how the 
average density varies across the screen, produces a beating pattern. 

20 The following describes, in a rigorous way, how this beating phenomenon occurs in 
multi-layered imaging systems. The situation presented in Figure 2a is similar for 
LCD panels that are spaced apart and have regularly sized and spaced apertures 
containing red, green and blue filters. 



25 Each filter of, each layer, is modelled separately with the spectral transmission 
function. This is overlaid upon a scaled 2D square wave with Lambertian luminance 
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of BLo or zero for the rear imaging layer ; and a transmittance of one or zero for the 
front imaging plane. The origin of this wave is at the optical axis shown as the 
vertical centre line on figure 2c. The black matrix (9) is included implicitly in this 
setup. The luminance/transmission functions are expressed mathematically in 
5 Equations 15 and 16 where the symbols are defined in Figure 3. The multiplication 
is expressed in the horizontal and vertical vectors in Equation 3. This idea is 



F(x 9 y) B 



\jfM F {BM XiF + 0P XtF + n x P XtF ) <x<M F (BM XtF + (P XtF - 2BM XtF ) + ?t x P XtF ) 
M F BM YF <y< M F (n y P YtF - BM YF ) 
Otherwise 

1 if M F (BM XF + lP XtF + n x P XtF )<x<M F (BM XF + (2P XtF - 2BM XtF ) + n x P XtF ) 
and M F BM Y F < y<M F (n y P Y F ~BM YF ) 
0 otherwise 

\ifM F (BM x F + 2P XtF + n x P XtF )<x<M F (BM XF + (3P X>F - 2BM XyF ) + n x P x>F ) 
and M F BM Y F <y<M F (n y P YF - BM Y F ) 
0 otherwise 



10 



(15) 



obviously portable to other technologies and optical configurations which could form 
the basis of multi-layered displays. 



15 The assignments in Equations 15 and 16 may look a confusing to the reader but the 
pattern within the braces is rather simple and the general form shown above it 



6 +n P <z< 

initial_phase_shifi P eriod 



<j> + Az +72 P 

initial phase shift change_in_dMance period 



R(x 9 y) B 



ljf_M R (BM x>R + 0P X>R +n x P x>R ) < x < M R (BM XR + (P X>R - 2BM X>R ) + n x P XjR ) ' 
M R BM Y)R < y < M R (n y P v>R — BM YR ) 
0 otherwise 

\ IJf M R ( BM XtR + 1P„ + n x P XtR ) < x < M R (BM XtR +(2P x #-2BM x ^) + n x P?$) 
and_M R BM YR <y< M R (n y P YR - BM YR ) 
0 otherwise 

\jfM R (BM XyR + 2P XiR + n x P XtR ) <x< M R (BM x R + (3P X>R - 2BM XtR ) + n x P x>R ) 
and_M R BM YtR <y< M R (n y P Y>R - BM YR ) 
0 otherwise 
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The layers are then set-up as shown in Figure 2c. This situation can be simplified 
by considering the same image produced on the retina by the rear layer, but where 
the rear layer is moved very slightly behind the front layer and suitably scaled. This 
will allow us to determine the final image with point by point multiplication of the 
separate layers. The use of radiometric rather than photometric quantities is 
required since the various filters need to be modelled. To scale this object, such that 
the image on the retina remains the same examine Figure 2c. Start with the fact 
that the area has to be preserved and from thin lens theory it is know that 



X R ~~ X Q — X 



<=> X 



and similarly z% . The illuminance on a plane a distance z 



away from a flat surface imaged by a thin lens (10) is 



„ <D LA'S 4fm 
£=— = — ^cos 4 (0) 

a az }2 (17) 



L (±jLf A s cos 4 (0) 
z f 



az 

4 



■2 



X^5cos 4 (^) 



az 



(18) 



where S is the area of the lens (10), L is the luminance of the rear display (11), A is 
the area of a small element on the rear display (12), a is a small element on the lens, 
<3> is the flux and E is the irradiance. This turns out to be the same no matter how 
far the rear panel is away from the lens. Take the diffuser into account by 
convolving the rear display image with the point source before changing its scale. 
To get the irradiance at the retina combine all of the separate layers using point by 
point multiplication and sum them as in Equation 19. 



R(x,y) B T(A\ R 



HFOcyWWw F{x,y) a T{X) a _ F F(x,y) B T(.X\ F )M 2 A leits cos 4 (0) 



(19) 
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Where BLois the radiance of the backlight, PSF(x,y) is the point spread function 
described earlier, Tued, Tg and Tb are the spectral transmission functions of the dye 
layers of the where second subscripts R and F designate the front and rear 
5 imaging layers respectively, M is the magnification of the thin lens system given by 
zVzo and Aiens is the area of the lens. 



Since visual perception is very difficult to measure directly, and varies from person 
to person an external reference to measure the image quality of a display is 

10 required. In most work the external reference is a physical artefact that transforms 
radiometric quantities into numbers. For these numbers to be useful they should 
have at least the following two properties: (a) If the numbers describing an aspect of 
image quality are the same for two displays then when asked observers comparing 
the two displays should report that this aspect of image quality is the same (b) If 

15 the numbers describing associated with two different displays are different then an 
observer should be able to report which has the greater magnitude. A third useful 
property is where the numbers describing the magnitude of a measured quantity 
agree with the magnitude described by an observer. Here we are interested with 
two conflicting quantities (a) image "clarity" of background layers which is 

20 compromised in a MLD to reduce the (b) saliency of moire interference produced. 
Vision science provides a description of the response to spatial frequency, the 
contrast sensitivity function (CSF), which is good starting point for producing the 
map between the response of the physical artefact and the "useful numbers" 
described. The CSF plots the contrast sensitivity (1/cutoff contrast) against 

25 angular frequency for human observers. 

CSF iai) = acoe- ba, ^l + 0.Q6e bm (20) 



0.7 x .o.2 



540(1 + ^)' 



1 + 



12 
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b(L) = 0.3(1 + Myu* 



Where L is the average display luminance, p is the angular display size in degrees 
and 60 is the angular frequency in cycles per radian related to the angular 
5 frequency of the display (cycles per radian) by 



a> = dv (21) 

Additionally there is no widely agreed standard for the contrast sensitivity function 
yet which describes the spatial response of the human visual system. At present 
10 there are several contenders which could be named as standard by the CIE, so in a 
preferred embodiment the CSF that becomes the standard for the art would be 
incorporated 

A naive display engineer about to place one image layer upon another would not 
15 expect Moire interference or the spatial qualities of the image on the rear display to 
differ. This is the ideal specification. This is better expressed by stating that only 
the difference between two sets of images matters. 

An image of text on the rear display diffused and the ideal un-diffused case, with 
20 the representations f d*> f d in the frequency domain. 

An image of the moire interference produced between the two layers and the ideal 
case of a uniform white surface the same area as the front most imaging layer, with 

the representation f m> f m* in the frequency domain. 

25 

The square root integral function compares an original and a distorted image where 
signal components are weighted by the contrast sensitivity function, and the result 
is expressed in just noticeable differences (JND). One JND between the two images 
would mean a difference that was noticeable half of the time. The Square Root 
30 Integral (SQUI) is calculated as 
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1*2) I iM,(y) (22) 



where 



M(y) = 



F x ,(v)/^(0) 



is defined as the modulation transfer function 



where F x<( v ) and F x( v ) are representations of the distorted and undistorted 
images in the frequency domain respectively and F x(°)= F x'(°) are the average 
luminance's of the distorted and undistorted images 
1 



M, = 



CSF(o>(y)) w here CSF (°>) is the contrast sensitivity function 



10 To find the distortion of our multi-layered display from the ideal in terms of JDN's 
use the following sum: 

M ln(2) I j M t (v) _ ^ " ln(2) v \ j M,(y) 

I 2 ln(2) I j M,(y) K K " ln(2) „j j M,(v) 

D = D X +D 2 
(23) 

20 

where v 0 is the smallest spatial frequency viewable on the display corresponding to 
the size of the display and Vmaxis the maximum frequency viewable by the human 
visual system. 



25 The first metric compares the filtered layer to the unfiltered layer. The second term 
in the metric compares the representation of the front screen to the back screen 
combination to the retinal of the front screen by itself. In a preferred embodiment 
the spectral information is calculated such that it forms each sub-term of the metric 
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is calculated via the square root integral- 
Many other metrics incorporating the contrast sensitivity function of the human 
visual system may be employed including the Modulation Transfer Function Area. 

According to another embodiment of the present invention there is provided an 
5 algorithm for predicting and optimising the trade-off between moire interference 
and image quality by use of a spatial filter within a multi-layered image system 
where said layers contain periodic elements. 

As shown in figure 2b display architecture is specified to algorithm which may 
include but is not limited to the following 

10 (a) the shape and dimensions of each pixel or sub-pixel (13,14), and the width of the 
black matrix (15,16) that surrounds the pixel or sub-pixel, which form the cell 
attached to each point on the lattice 

(b) The chromaticity co-ordinates of combinations of pixels or sub-pixels (17) of 
substantially the same or of different spectral absorption or emission characteristics 
15 on different layers. 

For example with two layers, each layer with RGB sub-pixels, the chromaticity co- 
ordinates of the following combinations are necessary 
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R 


G 


B 


R 


RR 


RG 


RB 




(x,y) 


(x,y) 


(x,y) 


G 


GR 


GG 


GB 




(x,y) 


(x,y) 


(x,y) 


B 


BR 


BG 


BB 




(x,y) 


(x,y) 


(x,y) 



5 Where, for example RR denotes a red sub-pixel is in front of a red sub-pixel, and 
(x,y) denotes the chromaticity co-ordinates measured when illuminated by a 
standard D65 source. Note that the combinations can be measured by using a 
commercially available photo- spectrometer, or calculated using Beer's law. 

Note that because of the effects of interstitial optical layers the co-ordinates of RB 
10 do not equal BR for example. In the general 2D case the matrix is not symmetric 
about its diagonal, and in the nD case the elements of the matrix transpose are not 
equal. 

(d) The distance of one display layer to the next and the refractive index of 
interstitial elements between layers 

15 (e) An approximation to the bi-directional transmission distribution function of each 
filter 

(f) The distances of each spatial filter from each display layer 
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The following MATLAB® code is provided by way of example only and details a 
possible implementation of the algorithm. The algorithm is in no way required to 
be implemented in MATLAB® and it should be appreciated that the comments in 
conjunction with figure 3 are sufficient to teach someone skilled in the art an 
5 implementation that is portable to any virtual or Turing machine. MATLAB® 

documentation, and the http links detailed in the notes section of each function are 
incorporated herein by way of reference. 

The first section of code provides a top-down script controlling the execution of the 
functions detailed below 

10 %Create the display 

D.Pixels.h=20; 

D.Pixels.v=l; 

D.subpixel_s.h=27; 

D.subpixel_s.v=10; 
15 D.blaekmatrix_s.v=l; 

D .blackmatrix_s .h= 1 ; 

D.trans_s.h=2; 

D.trans_s.v=2; 

save D D; 
20 load D ; 

X=createDisplay (D) ; 

image(X) 

titleCSingle layer 1 ) 
save X X; 
25 load X; 

X_blur = X; 



% Create the filter 
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H=createfilter([15, 10], 2000, [27,27], 1.5); 
figure; 
mesh(H); 
figure; 
5 mesh(H); 
figure; 
mesh(H); 
title(Tilter Plot 1 ) 

10 %blur the rear display and use to create moire 
sum(sum(sum(X_blur))); 
X„blur(:,:,l)=filter2(H,X(:,:,l)); 
X„bliir(:,:,2)=filter2(H,X(:,:,2)); 
X_blur(:,:,3)=filter2(H,X(:,:,3)); 
15 figure 

image(X__blur/max(max(max(X_blur)))); 
title('Blurred Layer 1 ) 
figure; 

save X_blur XJblur; 
20 load XJblur; 
load CM; 

%define viewing distance and distance between panels 

DD=0.010 

DE=0.07 

25 X.m^reateMoireCX^blu^X^D^E^M); 
colormap( f gray ! ) 

midPixel=round((D .Pixels .v* D .subpixel_s. v)/2) 



WO 03/079094 PCT/NZ03/00046 

33 

%plot the luminance of moire in 2D 
image(X„_m(: ? :,2)/(max(max(X^m(: ? : ? 2))))*255); 
title( f Luminance of moire 1 ) 
figure 

5 plot(X^m(midPixel ? : ? 2)/(max(max(X^m(midPixel,: J 2))))*255); 
line=X„m(midPixel ? :,2)/(max(max(X - m(midPixel,:,2))))*255; 

%need the dimentions of the scaled display for the next section 
S=size(X_m) 

10 %now plot the moire luminance minus the original luminance 
figure 

Xc = rgb2cie(X); 

Xcn = (Xc(midPixel,: ? 2)./(max(max(Xc(midPixel ? : ? 2)))))*255; 
size(X_m(midPixel ? :,2)) 
15 plot(abs(X^m(midPixel,: ? 2)-Xcn(S(2)))) 
image(abs(X - _m(midPixel,: > 2)-Xcn(S(2)))) 

%now look at fft of this result 
y=fft(abs(X_m(midPixel 5 :,2)/Xcn(S(2)))); 
20 figure 

loglog(sqrt(real(y). A 2 + imag(y). A 2)) 

title( ! Fast fourior transform of difference between images 1 ) 
%calculate the number that corrisponds to the cut off frequency 

25 

N = round((D.Pixels.h*D.subpixeLs.h*le-5*55*180)/(pi*DE)) 
The following function is a possible implementation of (17) on 
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Figure 3. Visual output (18) is shown in figure (4 ). 

% % 

% function createDisplay(D) % 

%Creates a display layer % 

5 % Variables % 

% D, where D is the following data structure % 
%D. Pixels. h -number of horizontal pixels 
%D .Pixels. v -number of vertical pixels 

%D.subpixel_s.h -size of the subpixel in micrometers (horizontal) 
10 %D.subpixel_s.v -size of the subpixel in micrometers (vertical) 

%D.blackmatrix_s.v -size of the black matrix in micrometers (horizontal) 
%D.blackmatrix_s.h -size of the black matrix in micrometers (vertical) 
%D.trans_s.h -size of the transistor in micrometers (horizontal) 
%D.trans_s.v -size of the transistor in micrometers (vertical) 

15 % Notes % 

%You should imagine the finished data structure as three seperate layers 
%with a colour for each 



% 



20 %Make the display, should be on three seperate layers 
subpixeLs=[D.subpixeLs.h,D.subpixel_s.v]; 
blackmatrix_s=[D.blackmatrix_s.h,D.blackmatrix_s.v]; 
trans_s=[D.trans_s.h,D.trans_s.v]; 

red = subpixel([l ? 0 ? 0] ? subpixel„s ? blackmatrix_s ? trans_s ? 0); 
25 green = subpixel([0, 1 ? 0] , subpixel_s ,blackm atrix_s , tr ans_s , 0) ; 
blue = subpixel([0,0,l] ? subpixel_s,blackmatrix_s ? trans_s ? 0); 
pixel = [red green blue]; 



% 
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The following function is a possible implementation of (19) on 

Figure (3) and graphs for the filter at 2 mm and 0.5 mm from the object layer in the 
horizontal direction (20) and the vertical direction ( 21) are shown on Figure (5) 

5 o /o============ ^ 

function H = createFilter(FWHMd,OD,size,N) 

% createFilter(FWHM,OD,size,N) % 

%This creates an image filter from the POC diffuser given the FWHM 
10 %characteristics, its distance from the display, the required size of the 
%filter in pixels and the refractive index of the intersticial optical 
%layer 

% Variables % 

%FWHMd - [horizontal FWHM, vertical FWHM ] in specification space 
15 %OD - z co-ordinate of diffuser in specification space 

%size - vector containing the number of vertical and horizontal pixels 

%respectively required for the filter - matrix notation!!! 

%N - the refractive index of the interstical optical layer 

% Notes % 

20 %reference : http://mathworld.wolfram.com/GaussianFunction.html 

%We make a couple of assumptions here: 

% - the bidirectional spread function of the diffuser is constant for any 
%input angle 

% ■ -% 

25 %save the world from bad input 

if FWHMd(l)>=90 | FWHMd(2)>=90 

error('FWHM angles must be less than 90 degrees 1 ) 
end 
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ifN<l 

error( f Refractive index must be greater than 1.0 1 ) 
end 

%read off the values from the vector to make code easier to understand 
5 m=size(l) 
n=size(2) 

%construct the x,y values to go through the function in a y*x*2 matrix 
%first construct the values of the rows and columns 
x= [-n:l:0,l:n] 
10 y = [-m:l:0,l:m] 

%use the outer product to replicate these values 
A(:, : , l)=rot90(ones(2*m+l, l)*x) 

A(:,:,2)=ones((2*n+l),l)*y 
%convert the diffuser specification from degrees to radians 
15 FWHMr = (FWHMd/180)*pi 

%calculate the apparent distance 
OD = OD/N 

%calculate the filter boundaries in terms of the full width half maximum 
FWHM(l) = abs(OD*tan(FWHMr(l))) 
20 FWHM(2) = abs(OD*tan(FWHMr(2))) 

%convert from full width half maximum to the standard deviation of the gaussian 

sigma=fwhm2sigma(FWHM) 

%calculate the un-normalized gaussian filter 

Hu=(l/(2*pi*sigma(l)*sigma(2))) * exp(-((A(: ? :,l). A 2/(2*sigma(l) A 2)) + 
25 A(:^2). A 2V(2*sigma(2) A 2))) 

%normalize - the image energy should be invariant 

Hn=Hu/sum(sum(Hu)) 
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%output the value 
H=Hn; 

function out = cie2rgb(in) 

The following function converts between CIE and 
5 RGB co-ordinates 



% 



% 



% function out = cie2rgb(in) % 

10 %converts an image that expressed in tristumulus co-ordinates into RGB % 
%co-ordinates 

% Variables % 

% in is the image in CIE 1931 tristimulus values (XYZ) 

% - Notes % 

15 % Reference: 

% http://www.cs.rit.edu/-ncs/color/t__convert.html 

% if the values are not within 0 and 1 then we truncate 

% % 

cie=in 

20 %This matrix defines the conversion from rgb to CIE 1931 

A= [3.240479 -1.537150 -0.498535; -0.969256 1.875992 0.041556; 0.055648 - 
0.204043 1.057311] 



% These equations transform cie in [0,1] to CIE 



out(:,:,l) = A(l,l)*cie(:, 
25 out(:,:,2) = A(2,l)*cie(:, 
out(:,:,3) = A(3,l)*cie(:, 



,1) + A(l,2)*cie(:, 
,1)+A(2,2)*cie(:, 
,1) + A(3,2)*cie(: 5 



,2)+A(l,3)*cie(:,:,3) 
,2) + A(2,3)*cie(:,:,3) 
,2) + A(3,3)*cie(:,:,3) 



%truncate the negative values 
out(out<0) = 0 



out(out>l) = 1 
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function I = addlmages(il,i2) 

function Moire = createMoire(R,F,DD,DE,CM) 

The following function is a possible implementation of (22,23,24) on 
Figure 3. Output is shown on figure (5) and (6), The effect on 
5 Moire interference with the filter at 0.1 mm (26,27) and 2 mm (28,29) is apparent by 
considering the lesser amplitude of the beating pattern in (27) compared to 
( 29). 

% createMoire(R,F,DD,DE,CM) % 

10 %Adds the colours of two images. If the images are of a different size % 
%then we take the intersection of the two starting from the top right 
%hand corner 

% Variables % 

% R - the rear image in RGB co-ordinates 
15 % F - is the front image in RGB co-ordinates 

% DD - is the distance between the image layers 

% DE - is the distance from the front most display to the eye 

% CM - is the matrix that describes how the colours interact 

% % 

20 %the way in which we scale the displays in incorrect at present. This is 

%the thrust of today's work 

% % 

% scale the displays 
25 %note that this is physically incorrect at the moment 
Dl = DD+DE; 
D2 = DE; 

FS = imresize(F,(D2/Dl)); 
S_FS=size(FS); 
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x=l:S_FS(l); 
y=l:S_FS(2); 

%multiply each layer pointwise - we are trying to find where in space each layer 
interacts 

5 %and at present this is an RGB before hand, but we seperate each of the layers out 
and 

%and interact the red layer of the front screen with the red layer of the rear screen 

%for example until we have all nine combinations. Each one of these combinations 
can be 

10 %is the luminance distribution for that colour combination 
Al=ones(size(FS ? l) ? size(FS 3 2) 5 3,3 ? 3); 
for k=l:3 
for m=l:3 

Al(:,:,k,m,l) = R(x,y,k) *FS(:,:,m) * CM(k,m,l); 
15 end 
end 

%Now for each combination k,l we need to assign CIE co-ordinates 
for k=l:3 
for m=l:3 

20 Al(:,:,k,m,2) = ones(size(Al ? l) ? size(Al,2))*CM(k ? m ? 2); 

Al(:,:,k,m,3) = ones(size(Al,l),size(Al ? 2))*CM(k,m ? 3); 
end 
end 

%change to tristimulis values so that we may take the arithmetic sum 
25 fork=l:3 

for m=l:3 

A2(:,:,k,m,:) = xyL2XYZ(Al(:,: ? k,m ? :)); 
end 
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end 

%Go through and add into a single image 
A4 = sum(A2,3); 
A5 = sum(A4,4); 
5 %now change to rgb co-ordinates 
A6 = cie2rgb(A5); 

%normalise for display on the screen 

%the if statement copes with the case where the maximum element is zero 
if (max(max(max(A6)))~=0) 
10 image(A6*(l/max(max(max(A6))))); 
else 

image(A6) 
end 

%return the CIE tristimulus values 
15 Moire=A5; 

function s = CSF(w,L,p) 

The following function is part a possible implementation of (26,27) on 
Figure 3 

20 

% s = CSF(w,L,p) % 

%Calculate the contrast sesitivity value of a give spatial frequency 

% Variables % 

%w - vector of spatial frequencies 
25 %L - luminance 

%p - the angular display size in degrees calculated from the square root 
%of the picture area 
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% % 

% GarethBell % 
% Date Created 21/02/03 % 
% Date Last Edited 21/02/03 % 
% Revision 0.2 % 

% Notes % 

%w3.hike.te.chiba-u.ac.jp/IEC/100/ PT61966/parts/partll/gemu-94.pdf 

%page 9 



% 



0_ 



10 

b = 0.3*(1 + 100/L). A 0.15; 

a = 540 * ((1 + 0.7/L) A (-0.2))./(l + 12./(p*(l+w/3). A 2)); 

s = a *w *exp(-b *w) *sqrt(l + 0.06 .* exp(b*w)); 

function Fnew = interpolate(F,P,domainX,domainY) 
15 % interpolate(F,P,domainX,domainY) % 

%This aproximates the value of a function at a specific points between 

%those that are defined by a numerically calculated function 

% Variables % 

%F - is a 2d matrix of function values 
20 %domainX - describes the x inputs to give F 

%domainY - describes the y inputs to give F 

%P - is a 2xn matrix of points that need to interpolated 

%TEST INPUT 

if (~sum(P(l,:) < min(domainX))==0) | (~sum(P(l,:) > max(domainX))==0 ) 
25 error('One or more x values out of range') 
end 

if (~sum(P(2,:) < min(domainY))==0) | (~sum(P(2,:) > max(domainY))==0 ) 



% 
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error ( f One or more y values out of range 1 ) 
end 

% % 

i = domainX 
5 j = domainY 
u = P(l,:) 
v = P(2,:) 

% Calculate the x and y differentials 

dFdx = diff(F,l,l) 
10 dFdy = diff(F,l,2) 

%Get the deltas 

uv = mymesh(u,v) 

dudv = uv - floor(uv) 

%Find the indexes of the u and v values 
15 [N,binU] = histc(u,i) 

[M,binV] = histc(v,j) 

%Calculate the aproximation 

UV=mymesh(binU+l ? binV+l) 

dz = dFdx(UV(:,:,l)) *dudv(:,:,l) + dFdx(UV(:,:,2» *dudv(:,:,2) 
20 %now find the function values 
Fnew = F(binV+l ? binU+l) + dz 

% % 

% function function out = cie2rgb(in) % 

%converts an image that expressed in RGB co-ordinates into tristimulus % 
25 %values 

% Variables % 

% in is the image in RGB values 
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% Revision 0.2 % 

% Notes % 

%% Reference: 

% http://www.cs.rit.edu/~ncs/color/t_convert.html 

5 % % 

rgb=in 

%This matrix defines the conversion from RGB to CIE1931 

A= [0.414253 0.357580 0.180423 ; 0.212671 0.715160 0.072169; 0.019334 0.119193 
0.950227] 

10 % These equations transform RGB in [0,1] to CIE 

out(:,:,l) =A(l,l)*rgb(:,:,l) + A(l,2)*rgb(:,:,2) + A(l,3)*rgb(:,:,3) 
out(:,:,2) = A(2,l)*rgb(:,:,l) + A(2,2)*rgb(:,:,2) + A(2,3)*rgb(:,:,3) 
out(:,:,3) = A(3,l)*rgb(:,:,l) + A(3 3 2)*rgb(: 5 :,2) + A(3,3)*rgb(:,:,3) 
% . 



15 % function stamp(Min ? nRows,nCols) % 

%makes nRows*nCols copies of a matrix Min % 

% Variables % 

% Min - the copy of the matrix that needs to be stamped % 
% nRows - the number of stamped rows 

20 % nCols - the number of stamped columns 

% Notes % 

row=Min; 
for i=l:(nCols-l); 
row=[row ? Min]; 

25 end 
M=Q; 

for i=l: (nRows); 



% 
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M=[M;row]; 
End 

The following function is a possible implementation of (28) on 
Figure 3. The data from figure 2a is used. 

5 

% 

function ColourFilter = 

SubPixel(PixelColour,PixelSize,BlackMatrixSize,TransistorSize,show) 

10 %function ColourFilter = 

SubPixel(PixelColour,PixelSize,BlackMatrixSize,TransistorSize,show) 

%Pixel colour is vector with [R,G,B] as red green and blue components respectively 

%Pixel size is vector with [hPixelSize,vPixelSize] in micrometers 

%BlackMatrixSize is vector : [hTraceWidth,vTraceWidth] in micrometers 

15 %Transitor sixe is vector : [hTransistorSize,vTransistorSize] in micrometers 

%Image is plotted if show is true 

%Make Colour filter 
close all 

20 ColourFilter=ones(PixelSize(2),PixelSize(l),3); 
for i=l:3 

i; 

ColourFuter(:,:,i)=ColourFilter(:,:,i) *PixelColour(i); %Make each layer of sub 
25 pixel a component of red, green or blue 

end 

%Add horizontal matrix and vertical matrix 
%Add left ends 
30 ColourFUter((l:BlackMatrixSize(l)),:,:)=0; 
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ColourFUter(:,(l:BlackMatrixSize(2)),:)=0; 
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%Add right ends ' 

hEnd=PixelSize(l)-(BlackMatrixSize(2)-l); 
5 vEnd=PixelSize(2)-(BlackMatrixSize(l)- 1); 



ColourFnter(:,(hEnd:PixelSize(l)),:)=0; 

ColourFilter((vEnd:PixelSize(2)),:,:)=0; 

TransistorSize 

10 %Add transistor 

ColourFilter((l:TransistorSize(l)),(l:TransistorSize(2)),:)=0; 

%Show image of pixel 
if show 

image(ColourFilter) ; 
15 axis([0,max(PixelSize),0,max(PixelSize)]); 
end 

function out = xyL2XYZ(in) 

% % 

% function out = xyL2XYZ(in) % 

20 %takes in a image in x,y,L co-ordinates (CIE 1931) and returns the % 

%tristimulus values % 

% Variables % 

% in - the image in x,y,L co-ordinates % 

% % 
25 Y = in(:,:,l)/683; 

sumXYZ=Y./(in(:,:,3)) 

X = in(:,:,2) *sumXYZ 
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Z = (1 - in(:,:,2) -in(:,:,3)).*sumXYZ 

out(:,:,l)=X; 

out(:,:,2)=Y; 

out(:,:,3)=Z; 

5 The following function is a possible implementation of (30,31) on 
Figure 3 

% SQRI(vx,vy,M) % 

% Calculate the square root integral metric 

% Variables % 

10 %M - is a matrix containing the power spectrum of the distorted 
%signal 

%vx,vy-are vector or matrix arguments of frequencies that correspond to 
%the power spectrum 

% Notes % 

15 %See Quality Aspects of Computer based Video Services for details 

% % 



v = vector2matrix(vx,vy) 

%Calculate ln(v) 
20 lnv(:,:,l) = log(v(:,:,l))+abs(log(min(vx))) 

lnv(:,:,2) = log(v(:,:,2))+abs(log(min(vy))) 

%Calculate d(ln(v)) 

[ny,nx,nz] =size(lnv) 

dlnvl = diff(lnv(:,:,l),l,2) 
25 dlnv2 = -diff(lnv(:, :,2), 1, 1) 

dlnv(:,:,l)=dlnvl(l:(ny-l),l:(nx-l)) 

dlnv(:,:,2)=dlnv2(l:(ny-l),l:(nx-l)) 

%Calculate the midpoints 
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Mdlnv(:,:,l) = lnv(l:(ny-l),l:(nx-l),l) + dlnv(:,:,l)/2 
Mdlnv(:,:,2) = lnv(l:(ny-l),l:(nx-l),2) + dlnv(:,:,2)/2 
%Calculate Mt 
clear Mt 

Mt(:,:,l) = CSF(v(:,:,l),100,50) 
Mt(:,:,2) = CSF(v(:,:,2), 100,50) 
Mt = sqrt(Mt(:,:,l) *Mt(:,:,2)) 
lnvx = lnv(l,2:nx-l,l) 
lnvy = lnv(2:ny-l,l,2) 
% Calculate the integral 
%form matrices 

N = interpolate(M,lnvx,lnvy f ,vx,vy) 
%calculate J 

% J = l/log(2)*sum(sum(sqrt(M(:,:,l) *M(:,:,2) ./Mt(:,:,l) *Mt(:,:,2))... 
% * Mdlnv(:,:,l) * Mdlnv(:,:,2))) 
%Going to have to be a loop 
dlnv=dlnv(:,:,l) *dlnv(:,:,2) 
J = 0 

for i=l:length(lnvx) 
for j=l:length(lnvy) 
i 
j 

J = J + sqrt(M(i^*Mt(ij))*dlnv(i,j) 
end 
end 

Figure 7 illustrates yet another preferred embodiment of the present invention 
implemented with a dual screen display (32) composed of a plurality of transparent 
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imaging screens in the form of a front LCD screen (33), parallel to, but spaced apart 
from a rear display screen (34) provided with a backlight (35) and spatial filter 
between the imaging screens (36). 

It should be apparent to one skilled in the art that a number of alternative display 
5 technologies may be utilised in place of the LCD screens. Furthermore figure 7 

shows a single screen (33) in front of the rear display (34) for the sake of clarity and 
convenience any number of additional (at least partially transparent imaging 
screens(33,34) may be incorporated. Although the rear screen (34) may also be a 
LCD screen it will be apparent that alternative, non- transparent display technology 
10 may be employed. 

Such displays provide a three dimensional quality to the scene viewed by an 
observer as displayed in the applicants co-pending patents PCT number 
PCT/NZ98/00098 and PCT/NZ99/00021, incorporated by reference herein. 

Thus for the sake of clarity and to aid understanding of the present invention, the 
15 display (32) and associated display screens (33,34) are shown in simplified 

schematic form in the drawings; elements not essential to illustrate the present 
invention are omitted from the drawings to aid comprehension. 

In this embodiment the point spread function acting upon the image is controlled 
by varying the apparent distance, determined by the index of refraction of the 
20 interstitial element between the holographic diffuser and the object layer; and the 
characteristics of the holographic diffuser. 

To aid understanding the effect of a holographic diffuser acting upon a single ray 
consider figure 8 where a single ray strikes the screen in position (37) producing a 
2D dirac delta function distribution. When the screen is moved to position (38) after 
25 the diffuser a 2D distribution depending on the scattering profile of the diffuser is 
formed. The profiles are typically Gaussian along any line in the x-y plane. 
Preferably the contours (39) are elliptical. More preferably the contours are 
rectangular (40). 

(41) shows a microscopic view of a circularly symmetrical holographic diffuser and 
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(42) shows a microscopic view of a non circularly symmetric holographic diffuser. 



Aspects of the present invention have been described by way of example only and it 
should be appreciated that modifications and additions may be made thereto 
5 without departing from the scope thereof. 
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1. A method of controlling the point spread function; 

in an optical system consisting of an object, at least one spatial filter, and the 
image projected by that object with said spatial filter(s) located between said 
object and said image where said point spread function is a result of the 
application of spatial filter(s) on said image; 

with said control of the point spread function being controlled by altering the 
distance between such image and said spatial filter(s) and altering the 
bidirectional scattering transmission function of the spatial filter(s). 

2. A method of controlling point spread function and abating moire interference; 

in an optical system consisting of at least two addressible object planes with 
periodicity and at least one spatial filter between at least two of the 
addressible object planes where said point spread function is a result of the 
application of spatial filter(s) on said image, 

with said point spread function being controlled by altering the distance 
between such image and said spatial filter(s) and altering the bidirectional 
scattering transmission function characteristic of the spatial filter (s). 

3. A method of controlling point spread function as in claim 1 or 2 where the 
spatial filter(s) are such that said spatial filter(s) produce an asymmetric 
bidirectional scattering transmission function. Issue - its not just any 
asymmetric bidirectional scattering transmission function. 

4. A method of controlling point spread function as in any of claims 1 to 3 or 5 to 
13 where at least one of the spatial filters is a holographic diffuser. 

5. A method of controlling point spread function as in any of claims 1 to 4 where 
said image on which said diffuser is acting is a pixelated image plane with 
each pixel being comprised of regular sub-components with said 
subcomponents being spread by the spatial filter not substantially more than 
the period of a pixel. 
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6. A method of controlling point spread function as in any of claims 1 to 4 where 
said image on which said diffuser is acting is a pixelated image plane with 
each pixel being comprised of regular sub-components with said 
subcomponents being spread by the spatial filter substantially within the 
boundary of the pixel. 

7. A method of controlling point spread function as in any of claims 1 to 4 where 
said image on which said diffuser is acting is a pixelated image plane with 
each pixel being comprised of regular sub-components with said point spread 
function being controlled such that each point of light within any 
subcomponent will be spread substantially to the nearest point or points on the 
boundary of the neighbouring sub-component that has identical 
characteristics. 

8. A method of controlling point spread function as in any of claims 1 to 4 where 
said image on which said diffuser is acting is a pixelated image plane with 
each pixel being comprised of regular sub-components being red, green and 
blue colour filters and said point spread function being controlled such that 
each point of light within each colour filter is spread substantially to the 
nearest point or points on the boundary of the neighbouring filters of the same 
colour. 

9. A method of controlling point spread function as described in any of claims 1 to 
8 or 10 to 13 where the image on which the spatial filter acts upon is a 
pixelated image plane comprised of a matrix pattern with said point spread 
function being controlled such that said matrix pattern is spread to normalise 
the luminance distribution across the matrix. 

10. A method of controlling point spread function as in claim 4 where at least one 
of said addressible object planes are addressable addressible object planes. 

11. A method of controlling point spread function as in claim 4 where at least one 
of said addressible object planes contains liquid crystal. 

12. A method of controlling point spread function as in claim 4 where at least one 
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of said addressible object planes contain organic light emitting diodes. 

13. A method of controlling point spread function as in claim 4 where at least one 
of said planes contain transparent organic light emitting diodes. 

14. A method of optimizing the spatial filtration of an image by use of a function 
5 incorporating the contrast sensitivity function of the human visual system. 

15. A method as claimed in claim n incorporating a method to predict the effect of 
an object with a given bi-directional scattering distribution function from the 
object being imaged. 

16. Results from experiments relating to either claim 14 or claim 15 

10 17. A method as claimed in any of claims 1 to 6 where the method will be used to 
optimize the trade off between moire interference and the subjective quality of 
the image within an imaging system 

18. A method as claimed in any one of claims 1 to 17 where the optical system is a 
multi-layered display. 



15 19. 



A method as claimed in any one of claims 1 to 17 where the optical system is a 
projection system 
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